BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on EVT-TOTAL events by Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[EVT-TOTAL]== 1529 ( 898) 1259 ( 898) 58.73 71.33 64.42
[JULIELab ] ==[EVT-TOTAL]== 1529 ( 879) 1374 ( 879) 57.49 63.97 60.56
[VIBGhent ] ==[EVT-TOTAL]== 1529 ( 776) 1154 ( 776) 50.75 67.24 57.85
[UT+DBCLS ] ==[EVT-TOTAL]== 1529 ( 739) 1072 ( 739) 48.33 68.94 56.82
[ConcordU ] ==[EVT-TOTAL]== 1529 ( 659) 897 ( 659) 43.10 73.47 54.33
[ UTokyo ] ==[EVT-TOTAL]== 1529 ( 660) 985 ( 660) 43.17 67.01 52.51
[ASU+HU+BU] ==[EVT-TOTAL]== 1529 ( 602) 849 ( 602) 39.37 70.91 50.63
[ UNSW ] ==[EVT-TOTAL]== 1529 ( 624) 995 ( 624) 40.81 62.71 49.45
[ UNIMAN ] ==[EVT-TOTAL]== 1529 ( 635) 1044 ( 635) 41.53 60.82 49.36
[ UZurich ] ==[EVT-TOTAL]== 1529 ( 638) 1084 ( 638) 41.73 58.86 48.83
[ SCAI ] ==[EVT-TOTAL]== 1529 ( 617) 1015 ( 617) 40.35 60.79 48.51
[ UAveiro ] ==[EVT-TOTAL]== 1529 ( 562) 857 ( 562) 36.76 65.58 47.11
[ Team 24 ] ==[EVT-TOTAL]== 1529 ( 567) 977 ( 567) 37.08 58.03 45.25
[ Cam ] ==[EVT-TOTAL]== 1529 ( 507) 744 ( 507) 33.16 68.15 44.61
[UAntwerp ] ==[EVT-TOTAL]== 1529 ( 533) 888 ( 533) 34.86 60.02 44.10
[CNBMadrid] ==[EVT-TOTAL]== 1529 ( 709) 1835 ( 709) 46.37 38.64 42.15
[ USzeged ] ==[EVT-TOTAL]== 1529 ( 616) 1473 ( 616) 40.29 41.82 41.04
[ NICTA ] ==[EVT-TOTAL]== 1529 ( 426) 676 ( 426) 27.86 63.02 38.64
[CCP-BTMG ] ==[EVT-TOTAL]== 1529 ( 377) 490 ( 377) 24.66 76.94 37.35
[CIPS-ASU ] ==[EVT-TOTAL]== 1529 ( 529) 1405 ( 529) 34.60 37.65 36.06
[ PIKB ] ==[EVT-TOTAL]== 1529 ( 340) 479 ( 340) 22.24 70.98 33.86
[ UMich ] ==[EVT-TOTAL]== 1529 ( 733) 3278 ( 733) 47.94 22.36 30.50
[ KoreaU ] ==[EVT-TOTAL]== 1529 ( 288) 456 ( 288) 18.84 63.16 29.02
[ Team 09 ] ==[EVT-TOTAL]== 1529 ( 332) 848 ( 332) 21.71 39.15 27.93
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[EVT-TOTAL]== 1535 ( 718) 1072 ( 718) 46.78 66.98 55.08
[ASU+HU+BU] ==[EVT-TOTAL]== 1535 ( 544) 849 ( 544) 35.44 64.08 45.64
[ Team 24 ] ==[EVT-TOTAL]== 1535 ( 550) 1021 ( 550) 35.83 53.87 43.04
[UAntwerp ] ==[EVT-TOTAL]== 1535 ( 508) 888 ( 508) 33.09 57.21 41.93
[CNBMadrid] ==[EVT-TOTAL]== 1535 ( 638) 1835 ( 638) 41.56 34.77 37.86
[CCP-BTMG ] ==[EVT-TOTAL]== 1535 ( 373) 490 ( 373) 24.30 76.12 36.84
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------